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AMENDMENTS TO THE CLAIMS 



1. (Previously Presented) A method for stabilizing an image of an object 
being taken from a video camera, the video camera being moved by a transport 
mechanism and being controlled by a line-of-sight controller, the line-of-sight controller 
having an orientation and an angular velocity, the method comprising: 
receiving a plurality of images of the object; and 
for each of the plurality of received images, 

receiving a distance from the video camera to the object, 
determining a difference between the location of the object within the 
image and the location of the object within a previously captured 
image, 

calculating an inter-frame stabilization adjustment based on the distance 
to the object and the difference between the location of the object 
within the image and the location of the object within a previously 
captured image, the inter-frame stabilization adjustment for 
adjusting the position of a display area of the received images, 

adjusting the position of the display area of the received images based on 
the inter-frame stabilization adjustment, wherein the received 
images are larger than the display area and the adjusting moves 
the display area relative to the received images, and 

controlling the line-of-sight controller at least in part by, 

calculating a line-of-sight adjustment for the line-of-sight controller 

based on the inter-frame stabilization adjustment, 
adjusting the orientation of the line-of-sight controller based on the 

calculated line-of-sight adjustment, 
calculating an angular velocity for the line-of-sight controller based 
on the inter-frame stabilization adjustment, and 
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setting the angular velocity of the line-of-sight controller to the 
calculated angular velocity. 

2. (Original) The method of claim 1 wherein the transport mechanism is an 
airborne vehicle. 

3. (Previously Presented) The method of claim 1 wherein the line of sight of 
the video camera is derived from the line-of-sight controller. 

4-5. (Cancelled) 

6. (Previously Presented) The method of claim 1 wherein the inter-frame 
stabilization adjustment specifies the number of pixels in scan and tilt directions. 

7. (Original) The method of claim 1 wherein the controlling of the line-of- 
sight controller specifies rate of scan and tilt movement. 

8. (Original) The method of claim 1 wherein the distance to the object is 
provided by a range finder. 

9. (Previously Presented) The method of claim 1 wherein the distance to the 
object is calculated based on the line of sight of the video camera and the difference in 
altitude of the object and the video camera. 

10. (Original) The method of claim 1 wherein the velocity of the transport 
mechanism is relative to the object. 

1 1 . (Original) The method of claim 1 wherein the velocity of the transport 
mechanism is relative to an earth frame of reference. 
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12. (Original) The method of claim 1 wherein the calculated inter-frame 
stabilization adjustment factors in field of view of the display. 

13. (Previously Presented) A method for stabilizing an image of an object 
being taken from a video camera, the video camera being moved by a transport 
mechanism and being controlled by a line-of-sight controller, the line-of-sight controller 
having an orientation and a pan rate, the image being displayed on a display device, the 
method comprising: 

determining a difference in the location of the object within the image from one 

frame to the next frame; 
adjusting the display of the image based on the determined difference to remove 

small-amplitude jitter; and 
controlling the line-of-sight controller by, 

calculating a line-of-sight adjustment for the line-of-sight controller based 

at least in part on the determined difference, 
adjusting the orientation of the line-of-sight controller based on the 
calculated line-of-sight adjustment to account for large-amplitude 
jitter, 

calculating a pan rate for the line-of-sight controller based at least in part 

on the determined difference, and 
setting the pan rate of the line-of-sight controller to the calculated pan rate. 

14. (Original) The method of claim 13 wherein the determining of the 
difference includes analyzing scan and tilt rate of the line-of-sight controller. 

15. (Original) The method of claim 13 wherein the determining of the 
difference includes analyzing velocity of the transport mechanism. 
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16. (Previously Presented) The method of claim 13 wherein the determining 
of the difference includes analyzing line of sight of the video camera. 

17. (Previously Presented) The method of claim 13 wherein the determining 
of the difference includes analyzing orientation of the video camera and the transport 
mechanism. 

18. (Original) The method of claim 13 wherein the determining of the 
difference includes recognizing the object within the images. 

19-34. (Cancelled) 

35. (Previously Presented) A method for stabilizing images being taken from 
a video camera mounted on a moving vehicle, the video camera having a line of sight 
being controlled by a line-of-sight controller, the line-of-sight controller having an 
orientation and a rate of rotation, the method comprising: 

calculating initial coordinates for a viewport, the viewport corresponding to a 

portion of an image that is to be displayed; 
calculating inter-frame stabilization adjustments based on the change in location 
of an object in a succession of image frames to account for a velocity of 
the vehicle, the inter-frame stabilization adjustments used to electronically 
move the viewport from one frame to the next frame; 
moving the viewport in accordance with the calculated inter-frame stabilization 
adjustments so that the viewport does not remain centered relative to the 
images taken from the video camera; 
displaying a portion of an image corresponding to the moved viewport; and 
controlling the line-of-sight controller at least in part by, 

calculating a line-of-sight adjustment for the line-of-sight controller based 
on the inter-frame stabilization adjustments, 
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adjusting the orientation of the line-of-sight controller in accordance with 

the calculated line-of-sight adjustment, 
calculating a rate of rotation for the line-of-sight controller based on the 

inter-frame stabilization adjustments, and 
setting the rate of rotation of the line-of-sight controller to the calculated 

rate of rotation. 

36. (Original) The method of claim 35 wherein the calculating of the inter- 
frame stabilization adjustments factors in scan and tilt rate of the line-of-sight controller. 

37. (Previously Presented) The method of claim 35 wherein the calculating of 
the inter-frame stabilization adjustments factors in line of sight of the video camera. 

38. (Previously Presented) The method of claim 35 wherein the calculating of 
the inter-frame stabilization adjustments factors in orientation of the video camera and 
the vehicle. 

39. (Original) The method of claim 35 wherein the calculating of the inter- 
frame stabilization adjustments includes recognizing an object within the images. 

40. (Original) The method of claim 35 wherein the calculated line-of-sight 
adjustment specifies a scan and tilt rate for the line-of-sight controller. 



3676 1 -80 1 6.US0 1/LEGAL1 7828978. 1 



6 



Application No. 10/726,334 

After Final Office Action of March 3, 2010 



Docket No.: 36761 801 6US1 



41. (Cancelled) 

42. (Currently Amended) The method of c l aim 41, further compr i sing:A 
method in a camera stabilization system for stabilizing the display of images received 
from a video camera attached to an aircraft and controlled bv a gimbal-based line-of- 
sight controller, the method comprising: 

receiving a first image from the video camera: 

receiving a second image from the video camera: 

determining the position of an object in the first image: 

determining the position of the object in the second image: 

determining an image pixel offset in the scan direction. \PO(S). based on the 

difference in the position of the object in the first and second images: 
determining an image pixel offset in the tilt direction. IPO("Q. based on the 

difference in the position of the object in the first and second images: 
determining a pixel offset in the scan direction. PO(S). based on IPO(S): 
determining a pixel offset in the tilt direction. PO(T). based on IPO(T): 
adjusting the display of an image on a display device of the camera stabilization 

system based on PO(S) and PO(T): 
converting PO(S) to a corresponding scan angle based on the field of view of the 

video camera: 

converting POm to a corresponding tilt angle based on the field of view of the 
video camera: 

adjusting a scan rate of the line-of-sight controller based on the scan angle: 
adjusting a tilt rate of the line-of-sight controller based on the tilt angle: and 
determining aircraft pixel offsets caused by the movement of the aircraft by, 

receiving an indication of the velocity of the aircraft in the earth reference 
frame, V a ^ rcraft , 

receiving a matrix, C B e, corresponding to the orientation of the aircraft in 
the earth reference frame, 
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receiving a matrix, C C b, corresponding to the orientation of the video 
camera, 

calculating a transformation matrix, C C e, for transforming from the earth 
reference frame to the camera reference frame, wherein 
Cce=CcbCbe, 

calculating a line of sight, L E of the video camera in the earth reference 

frame, wherein L e =C C e t (1,0,0) t , 
determining the distance, K, to an object at the center of the image, 
determining the velocity of the aircraft in the camera reference frame, 

V£ rcraft , wherein V' craft =C CE * V* craft , 
calculating a normalized velocity of the aircraft V a c ; rcraft = V^/K, 
calculating a first difference in scan units ASf, wherein 

ASf = Vg^ft (S)* AT , wherein (S) corresponds to the 

normalized velocity of the aircraft in the scan direction, and wherein 

AT corresponds to a frame refresh period, 
calculating a first difference in tilt units AT, C , wherein AT, C = V^f, (T)* AT , 

wherein (T) corresponds to the normalized velocity of the 

aircraft in the tilt direction, 
calculating an aircraft pixel offset in the scan direction APO(S), wherein 

APO(S)= ASf * P/Z, wherein P corresponds to a pixel density 

associated with the video camera, and wherein Z corresponds to a 

zoom factor associated with the video camera, 
calculating an aircraft pixel offset in the tilt direction APO(T), wherein 

APO(T)=AT 1 c *P/Z 
wherein PO(S) is determined based on IPO(S) and APO(S), and 
wherein PO(T) is determined based on IPO(T) and APO(T) 
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so that both the display of the image and the line-of-siaht controller are adjusted 
based on IPO(S) and IPO(T) . 

43. (Previously Presented) The method of claim 42, further comprising: 
determining camera pixel offsets caused by the rotation of the video camera by, 

receiving the instantaneous camera scan rate IS, 
receiving the instantaneous camera tilt rate IT, 

calculating a second difference in scan units, ASj, wherein AS2=IS*AT, 
calculating a second difference in tilt units, AT 2 C , wherein AT 2 C =IT*AT , 
calculating a camera pixel offset in the scan direction, CPO(S), based on 

AS° 2 , 

calculating a camera pixel offset in the tilt direction, CPO(T), based on 

AT 2 C 

wherein PO(S) is determined based on IPO(S), APO(S), and CPO(S), and 
wherein PO(T) is determined based on IPO(T), APO(T), and CPO(T). 

44. (Previously Presented) The method of claim 1 , further comprising: 
receiving an indication of a user-specified image flow; and 

controlling the line-of-sight controller in accordance with the user-specified image 
flow so that the object moves relative to the display area. 

45. (Previously Presented) The method of claim 13 wherein controlling the 
line-of-sight controller includes compensating for a user-specified image flow. 
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